System and method for assisting communication through predictive speech

ABSTRACT

A system and method for assisting communication through predictive speech is provided. A database includes commonly used words, phrases, and images, each associated with at least one context cue. A processor is configured to determine the user&#39;s context and provide a number of possible initial phrases associated with the determined context. Further words, phrases, or images are provided following, and based at least in part on, user selection of the initial phrase. The selected initial phrase and the subsequently selected words, phrases, and images are communicated.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. Non-Provisional applicationSer. No. 16/502,119 filed Jul. 3, 2019, which claims the benefit of U.S.Provisional Application Ser. No. 62/694,467 filed Jul. 6, 2018, thedisclosures of all of which are hereby incorporated by reference as iffully restated herein.

TECHNICAL FIELD

Exemplary embodiments relate generally to systems and methods forassisting communication, particularly for those who have difficultyspeaking, by generating predictive words or phrases based on context,thereby permitting faster and more accurate communication.

BACKGROUND AND BRIEF SUMMARY OF THE INVENTION

Verbal communication is often taken for granted. It becomes so “secondnature” that individuals often forget that everyone enters this worldspeechless. Many individuals go through life never worrying about theirability to verbally communicate with others. However, many others arenot afforded the same luxury.

For those who suffer from a speech related ailment, such as a stroke,nonverbal autism, throat surgery, or ALS, to name just a few examples,the person needs to communicate quickly and efficiently using a languagethey already know. To this end, healthcare facilities generally employsimple preprinted cards with words or pictures to help facilitatecommunication with patients who have difficulty speaking. Theserudimentary cards severely limit the person's ability to accuratelyexpress their inner thoughts. There is little or no room for variation.The cards do not take into account the mental capacity of the patient.Beyond asking for the essentials to live, such as water, food, toilet,there is no meaningful dialogue that may be exchanged with doctors andloved ones.

Attempts have been made to give people who have difficulty speaking avoice through interactive programs on electronic handheld devices.However, these programs are largely just digitized forms of the samecards that hospitals show to patients. There is little to no room toaccurately express inner thoughts and have meaningful conversations.This is a common problem among Augmentative and AlternativeCommunication (“AAC”) systems. Today's AAC systems are generally limitedto slow communication for the bare essentials.

Certain words are generally spoken in the context of what was alreadyspoken. For example, certain phrases and statements are often made inresponse to certain statements made by others. As a further example,some words or phrases are more commonly used in connection with wordsalready spoken by the person in order to form a complete sentence orfurther statements. Furthermore, people tend to use certain words orphrases more often than others. Some of this may be due to culture,upbringing, or personality. Often times, people use particular words orphrases depending on what is spoken to them, their location, who theyare speaking to, or other contextual considerations. As such, the widenumber of possible words or phrases to use can sometimes be limitedbased on context. Therefore, what is needed is a system and method whichpermits those who have difficulty speaking to effectively and quicklycommunicate to those around them with assistance of an electronicdevice, particularly one where words and phrases to be audiblytransmitted are made available to the user in a predictive fashion basedon context.

The present disclosures provide a system and method which permits thosewithout the ability to speak, or with speech difficulties, toeffectively and quickly communicate to those around them with assistanceof an electronic device based on context. In exemplary embodiments,words and phrases for potential selection may be generated in apredictive fashion based on one or more context cues. These context cuesmay include user preferences, time of day, location, audience, somecombination thereof, or the like. The predicted words and phrases may beselected based on words and phrases used in the same or similar contextsby the user. Alternatively, or additionally, the predicted words andphrases may be selected based on context such as what is spoken to theuser, the user's location, the user's audience, some combinationthereof, or the like.

The present disclosures provide an easy to use interface that updatesquickly to enable the user to easily select a following word or phrasebased on context cues. This interface may appear on any electronicdevice, preferably a portable device such as a smart phone, laptop,tablet, or the like. The interface may comprise text that previews thewords or phrases about to be spoken by the electronic device. The textmay be updated with each new word(s) or phrase input by the user. Theuser may have the option to type the next word(s) or phrase they wish tospeak or select a word(s) or phrase from displayed list of words,phrases, and/or pictures. As each new word or picture is typed,selected, or otherwise indicated, the text may be updated and a new setof words or pictures may appear for subsequent selection, preferablybased on the context of the existing text. Upon completion of thedesired phrase(s) and/or sentence(s), the user may initiate the audibletransmission of the phrase(s) and/or sentence(s). Additionally, oralternatively, words and/or phrases may be audibly transmittedautomatically as they are selected by the user in substantially realtime. Such an interactive and predictive system may afford people whohave difficulty speaking a fuller, more expressive vocabulary.

Further features and advantages of the systems and methods disclosedherein, as well as the structure and operation of various aspects of thepresent disclosure, are described in detail below with reference to theaccompanying figures.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

In addition to the features mentioned above, other aspects of thepresent invention will be readily apparent from the followingdescriptions of the drawings and exemplary embodiments, wherein likereference numerals across the several views refer to identical orequivalent features, and wherein:

FIG. 1 is a simplified plan view of an exemplary system;

FIG. 2 is a simplified block diagram illustrating exemplary logic foruse with the system of FIG. 1 ;

FIG. 3A depicts an exemplary user-interface for use with the system ofFIG. 1 ; and

FIG. 3B depicts an updated exemplary user interface for use with thesystem of FIG. 1 .

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENT(S)

Various embodiments of the invention will now be described in detailwith reference to the accompanying drawing. These figures are merelyprovided to assist in the understanding of the invention and are notintended to limit the invention in any way. One skilled in the art willrecognize that various modifications and changes may be made to any ofthese example embodiments without departing from the scope and spirit ofthe present invention.

Embodiments of the invention are described herein with reference toillustrations of idealized embodiments (and intermediate structures) ofthe invention. As such, variations from the shapes of the illustrationsas a result, for example, of manufacturing techniques and/or tolerances,are to be expected. Thus, embodiments of the invention should not beconstrued as limited to the particular shapes of regions illustratedherein but are to include deviations in shapes that result, for example,from manufacturing.

Referring to FIG. 1 , a user device 110 may be in electroniccommunication with an external server 114. Such communication may bemade by way of a network 112, such as but not limited to, an internet,intranet, cellular network, the world wide web, some combinationthereof, of the like. The user device 110 may be a smart phone, laptop,desktop computer, tablet, watch, fitness tracking device, or any otherelectronic device(s), preferably capable of visually displaying andupdating text and audibly transmitting selected words and/or phrases,directly or indirectly, such as through separate speakers. Anapplication may be installed on the user device 110. In other exemplaryembodiments, the user device 110 may be a specially designed alternativecommunication device having the application pre-installed thereon. Instill other exemplary embodiments, without limitation, the applicationmay be a web-based platform accessibly by way of the user device 110. Insuch embodiments, only a minimal amount of program data may be stored atthe user device 110 and the majority of program data may instead bestored in one or more remote databases 116 and/or the one or moreservers 114. Such databases 116 may be in electronic communication withthe user device 110 by way of the external server 114 and/or the network112.

The database 116 and/or the user device 110 may comprise one or morenon-transitory computer-readable mediums which may comprise a variety ofsoftware instructions and/or user data. In exemplary embodiments, thedatabase 116 and/or the user device 110 may comprise a number of words,phrases, and images, each associated with one or more context cues. Asfurther described herein, any number and type of context cues arecontemplated such as, but not limited to, other words, phrases, orimages, user location, time of day, user mood, some combination thereof,or the like.

In exemplary embodiments, the application configures the user device 110to execute one or more software instructions, which may comprise one ormore predictive algorithms. When executed, the software instructionsand/or predictive algorithms may gather information from the user device110 and/or the database 116 and uses the gathered data to select fordisplay the next words or phrases likely to be entered by the user. Forexample, without limitation, words, phrases, and/or images associatedwith the user's current context may be gathered and displayed at theuser device 110 for selection. The selected words, phrase, or images maybe audibly transmitted as selected, or may be displayed in an updatingtext and the user may elect to audibly transmit the text once formed tothe user's satisfaction.

FIG. 2 is a simplified block diagram with exemplary logic for use withthe system of FIG. 1 . Predicted words, phrases, or images may begenerated. In exemplary embodiments, the user device 110 may draw upondata stored at the database 116 and/or locally on the user device 110 togenerate the predicted words, phrases, or images relevant to thedetermined context. For example, without limitation, context specificpredicted words or phrases may be provided based on user location, timeof day, mood, some combination thereof, or the like. However, any numberand type of context clues are contemplated.

The predicted words, phrases, or images may be displayed to the user atthe user device 110. The user device 110 may await user input. The userdevice 110 may update the displayed text according to the userselection. If required, the entire, or just the updated portion, of thetext may be audibly transmitted. The user data may be updated at thedatabase 116 and/or locally on the user device 110. In exemplaryembodiments, the words, phrases, and/or images selected may be recordedin association with the user context such that such words, phrases,and/or images may be generated for display and user selection when theuser is in the same or similar context at a future time. Each time auser selects particular words, phrases, and/or images, such words,phrases, and/or images may more often be generated for display and userselection.

The application, potentially comprising one or more predictivealgorithm(s), may rely on a number of factors and sources of informationto assist in accurate prediction of likely next words or phrases. Thefactors and sources of information may include a general predictiveformula that draws upon known word combinations, or corpora. Suchcorpora may be taken from works of literature, newspapers, movie ortelevision show scripts, or any other written text or audible words.These works may be taken from a variety of languages to permitinternational application of the inventive system.

Alternatively, or additionally, the predictive algorithm(s) may drawupon is the actual words, sentences, or phrases previously entered bythe user to speak, preferably in the same or similar contexts as acurrent context. For example, without limitation, a user may havepreviously caused the user device 110, by way of the application, tospeak the phrase “I need to go to the” followed by a particular word(s)or phrase. The user may then frequently have caused the user device 110,by way of the application, to speak the phrase “doctor”, “bathroom”,“house”, “store”, “office”, “park”, some combination thereof, or thelike, just to name a few examples, without limitation. In such cases,the application may be configured to recognize that after speaking thephrase “I need to go to the”, the user's next word(s) or phrase iscommonly one of such places. The user device 110, by way of theapplication, may be configured to generate such word(s) or phrases forselection.

After selecting the next phrase, such as “doctor”, the application maybe configured to recognize that after speaking “doctor”, the user's nextword(s) or phrase is commonly one of temporal context such as “now”,“later”, “tomorrow”, explanation such as “because”, some combinationthereof, or the like, just to name a few examples, without limitation.The user device 110, by way of the application, may be configured togenerate such word(s) or phrases for selection. Alternatively, the usermay be finished after adding doctor and the user may indicate that thetext is ready for audible transmission. After audibly transmitting thesentence, the user's preferences may be updated at the database 116and/or the user device 110. In such situations, the user's preferencesmay associate the words with the user's present context such as, but notlimited to, the user's location, time of day, mood, some combinationthereof, or the like.

As another example, without limitation, a user may have previouslycaused the user device 110, by way of the application, to speak thephrase “How are you?” many times a day. A common response from thelistener may be “I am well, how are you?” The user may then frequentlyhave caused the user device 110, by way of the application, to speak thephrase “Great, thanks for asking.” in response. The application may beconfigured to recognize that after speaking “How are you?” the user'snext sentence is often a response about how the user is doing. Morespecifically, the application may be configured to predict a preselectedphrase the user has previously spoken in similar situations, in thiscase the phrase, “Great, thanks for asking.” Additionally, the user maybegin typing the response, for example without limitation, G, R, E, andthe algorithm may be configured to update and fill in the phrase for theuser. For example, without limitation, the application may either put inthe initial word “Great” or the entire phrase commonly spoken by theuser or by the general predictive formula “Great, thanks for asking.”

In other embodiments, the user device 110 may be capable of listening toexternal speech, for example without limitation, by way of one or moremicrophones. The user device 110 may be configured to capture externalspeech and use the external speech as an input to determine context forpotential responses. In this way, the application may be updated basednot only on the most common phrases the user selects, but also on themost common phrases the user hears as well as the user's most commonresponses thereto. Such sentences, phrases, or words may be associatedwith various users and stored at the database 116 for use by theapplication in generating predicted sentences, phrases, or words.

Alternatively, or additionally, the application may be configured tomake such predictions by drawing on more than just the number of times aphrase has been spoken. For example, without limitation, suchpredictions may, alternatively or additionally, also be based on contextsuch as, but not limited to, the time of day, how recently the phrasewas spoken, and/or the location of the user. For example, if theapplication is being utilized early in the morning, as determined by theuser device 110, the application may generate an initial set of phrasescommonly spoken in the morning. Examples of such phrases may include,but are not limited to, “Good morning,” “How did you sleep,” or “I wouldlike a cup of coffee.” Such sentences, phrases, or words may beassociated with various times of day and stored at the database 116 foruse by the application in generating predicted sentences, phrases, orwords. Of course, these are just examples and they are not intended tobe limiting. Those of skill in the art will realize that the predictionsmay be made based on any number and type or context factors.

The application may be further configured to provide predictions basedon how recently the phrase was spoken. For example, without limitation,a person may go through a phase of calling acquaintances “friend.”“Hello there, friend.” “How are you doing, friend?” However, habitschange and so should the predictive algorithm. Just because two monthsago the user used to say “friend” often, does not mean that user'smannerisms have not changed since then. For example, without limitation,the application may be configured to determine that the user hasrecently being using different words, phrases, or sentences such as“Hello there, buddy” or “What is going on, bud?” The application may beconfigured to recognize that recently the user has been using the word“buddy” or “bud” instead of “friend” and generate predictive words orphrases for display and selection accordingly. This may allow for a morefluid speaking application which more accurately adopts to themannerisms of the user to better reflect his or her natural persona,charisma, and the like. Such sentences, phrases, or words may beassociated with various users and stored at the database 116 and/or userdevice 110 for use by the application in generating predicted sentences,phrases, or words.

The application may be further configured, alternatively oradditionally, to generate predicted words and phrases based on thelocation of the user device 110. In exemplary embodiments, the userdevice 110 may comprise one or more location detection devicesconfigured to automatically determine the user's location. In otherexemplary embodiments, the user device 110 may be configured to acceptmanual entry of a location. Such sentences, phrases, or words may beassociated with various locations and stored at the database 116 for useby the application in generating predicted sentences, phrases, or words.

This location can be small in scale, such as different rooms of thehouse: bedroom, bathroom, kitchen. This location may be large in scale,such as recognizing the city or state the user is located in. Commonphrases such as, but not limited to, “I am hungry.” or “What are wehaving for dinner.” may appear when the application determines that theuser is in the kitchen. Other phrases such as, but not limited to,“Please help me make my bed.” or “What show would you like to watch?”might be generated when the user device 110 determines that the userdevice 110 is in the appropriate room of the home. Similarly, if theuser device 110 were to determine a location of Washington D.C., wherethe user is vacationing for example, the application may be configuredto generate a sentence starting in “I want to go to . . . ” may befollowed by predictions of “the Washington Monument,” “the White House,”or “the Smithsonian Institution.” Conversely, when the user device 110determines that the user is at home, the application may be configuredto generate a sentence starting with, for example without limitation, “Iwant to go to . . . ” may be followed by predictions of the user'sfavorite book store or restaurant, for example without limitation. Suchpoints of interest may be stored at the database 116 for use by theapplication in generating predicted sentences, phrases, or words.

In exemplary embodiments, the user device 110 may be configured toprompt and receive user input regarding points of interests. Forexample, without limitation, the user may enter the name of commonlyvisited restaurants, stores, parks, or the like. Such preferences may bestored at the database 116 for use by the application in generatingpredicted sentences, phrases, or words. The user device 110 may befurther configured to prompt and receive user input regarding variouslocations. For example, without limitation, the user may indicate that aparticular location is the user's home, bedroom, kitchen, relative'shouse, friend's house, favorite restaurant, favorite store, favoritepark, and the like. Such preferences may be stored at the database 116and/or user device 110 for use by the application in generatingpredicted sentences, phrases, or words.

Although the factors of corpora, location, time of day, and past use aredescribed above, such examples are not intended to be limiting. Anymeans of predicting speech may properly be within the scope and spiritof this application. For example, without limitation, the user device110 may be configured to detect the user's mood. Such mood detection maybe accomplished by way of facial recognition technology, heartbeatdetection, perspiration levels, pupil dilation, respiratory rate, userinput, some combination thereof, of the like. Such detection may be madedirectly by the user device 110 or through one or more monitoringdevices 118 in communication with the user device 110. Such monitoringdevices 118 may include, without limitation, smart watches, fitnesstrackers, vitals monitoring devices, or the like. For example, withoutlimitation, the user device 110 and/or one or more peripheral devices118, may be configured to detect depression, anxiety, agitation,happiness, some combination thereof, or the like. The application may beconfigured to generate predicted words or phrases based on the user'sdetermined mood. Such sentences, phrases, or words may be associatedwith moods and stored at the database 116 and/or user device 110 for useby the application in generating predicted sentences, phrases, or words.

Alternatively, or additionally, the application, for example withoutlimitation, may be configured to display emergency phrases such words as“Help!” or “Look out!” for display and user selection and conversion tospeech where anxiety, elevated heartbeat, shallow respiration, increasedperspiration, or the like is detected. Such a prediction may be neededto quickly alert and grab the attention of others nearby. Furthermore,such emergency phrases may be made available at the user device 110regardless of the ability to track various moods. Such emergency phrasesmay be made available by depressing one or more emergency buttons orupon initial access to the user device 110 or application, for examplewithout limitation.

Referring additionally to FIG. 3A and FIG. 3B, an exemplary userinterface is depicted. The interface may comprise a keyboard 210. Inexemplary embodiments, the application may be configured to display thekeyboard 210 at all times. The application may be further configured todisplay a predictive field 212 comprising a number of predicted words,phrases, images, some combination thereof, or the like. The predictivefield 212, in exemplary embodiments, may be displayed above the keyboard210. The application may be configured to display a text field 214 abovethe predictive field 212. As the user types or selects one or more ofthe predicted words or phrases 212, the text field 214 may beautomatically updated to reflect the words or phrases selected from thepredictive field 212. The predictive field 212 may be updated as theuser types or selects a word or phrase.

In the depicted example of FIG. 3A, the user has already selected, orthe application has already generated, the initial phrase “I need to goto the”. Such user selection may be made, for example withoutlimitation, by typing or selecting such predicted words or phrases fromthe predictive field 212. As another example, without limitation, theinitial phrase may be automatically populated or provided within a listof other possible initial phrases based on the user's location, time ofday, preference, mood, some combination thereof, or the like. Theapplication may be configured to generate and display a set of possiblenext words in the predictive field 212. The user device 110 may beconfigured to accept user input at the keyboard 210 or the predictivefield 212. For example, without limitation, if the user were to type theletter “b” next, the application may be configured to update thepredictive field 212 with only words and phrases beginning with theletter “b:”, such as bank, backyard, and bathroom in the illustratedexample. The user device 110 may also be configured to receive userinput indicating the selection of one or more of the words, images, orphrases display in the predictive field 212. In exemplary embodiments,without limitations, the words, phrases, images, or sentences in thepredictive field 212 may be determined be the algorithm. The algorithmmay, for example without limitation, may select the words, phrases,images, or sentences in the predictive field 212 by the user's location,time of day, mood, preference, some combination thereof, or the like.

In the depicted example of FIG. 3B, the user has selected the predictedword “doctor.” The application may be configured to display an updatedtext field 214 as well as an updated predicted field 212. All fields mayupdate in substantially real time to provide for fluid communication andminimal delay for the user in crafting a complete sentence(s) orphrases.

The user device 110 may be configured to monitor for user inputindicating the selection of the audio button 216. Upon determinationthat such a selection has been made, the application may be configuredto audibly transmit the current text field 214. Such transmission may beachieved using speech to text software. Such transmission may be made byway of speakers at the user device 110 or at another location. Forexample, without limitation, the speakers may be wirelessly connected bya near field transmission system. As another example, withoutlimitation, the speakers may be provided at the user device 110. Oncethe sentence is transmitted, the application may be configured to returnto the initial page with a blank line 214. Although only single wordsare depicted in FIGS. 3A and 3B for the predictive field, 212 phrases,images, or the like may be used to add further ease of operation. InFIG. 3B, some common phrases may be, for example without limitation,“because I have an appointment” or “for my yearly check-up.”

In exemplary embodiments, without limitation, context may be the presentdate, day of the week, or the like. For example, without limitation, theuser device 110 may be configured to sync with a calendar, planner,to-do list, appointment reminder, or other application installed on theuser device 110 and/or one or more peripheral devices 118. The contextcue may include the name, time, date, location, or other informationregarding appointments, dates, events, reminders, to-do's, or the likestored on such other applications. For example, without limitation, theapplication may be configured to generate the phrase “When are weleaving for my hair appointment” a predetermined time before thescheduled event for a haircut. As a further example, without limitation,context may comprise the day of the week. For example, withoutlimitation, an initial phrase “Let's go to . . . ” may be selected, andbecause the day of the week is Sunday, “Church” may be generated as apotential further word for selection. The user may be know to visitparticular places certain days

The location, font, arrangement, orientation, style, and the like of thekeyboard 210, the predicted words or phrases 212, the text field 214,and the audio button 216 are merely exemplary and are not intended to belimiting. Any location, font, arrangement, orientation, style, and thelike are contemplated.

In exemplary embodiments, the application may be configured to generate,for display at the user device 110, an initial interface upon initialaccess to the application or transmission of a sentence. The initialinterface may provide a variety of options for selection by the user tobegin a sentence. The initial interface may comprise a set of commonopenings to sentences or phrases, such as but not limited to, “I need togo to the . . . ,” “Hello.” or “Excuse me.” Shorter selected phrases orsentences may automatically be audibly transmitted such that the user isnot required first select “Hello” and then also select the audio button216. The initial interface may also permit a user to select a morepointed category of speech to predict from. Such categories may include,for example without limitation, workplace, home, or vacation. For aworkplace example, the user may be able to retain an employment positionas a host or hostess of a restaurant. Common phrases such as, withoutlimitation, “Hello,” “How many in your party?” “Please follow me,” or“The wait will be about . . . ” may permit more natural conversationwith customers. One of ordinary skill in the art will recognize thatthis is merely one workplace example of how only a few short phrasesreadily available may open employment opportunities previously notavailable. Such initial phases or short sentences may be automaticallydetermined by the algorithm or may be manually selected or entered bythe user. For example, without limitation, the user may pre-program aset of work phrases, home phrases, transportation phrases, or the like.As a further example, without limitation, a user may select certainphrases or sentences to be added to a favorites list.

In exemplary embodiments, each of the words or phrases generated anddisplay in the predictive field 212 may comprise a combination of words218 and pictures 220. This may be particularly beneficial immediatelyafter a tragic incident has occurred leaving the user with speechdifficulties. It may be difficult to determine the user's cognitiveability at this time and both the pictures and words may form anassociation within the user's mind allowing him or her to communicatewith greater ease. Additionally, the user may be drawn to a picture morereadily and may be able select the associated picture faster thanreading all words in the predictive field 212.

In exemplary embodiments, an image may be displayed adjacent to, orotherwise in association with the words or phrases in the predictivefield 212. In this way, the user may associate the image with the wordor phrase. This may permit for easier selection. For example, withoutlimitation, an image of a plane may be displayed next to the word“airport” and/or an image of a dollar bill may be displayed next to theword “bank”. As a further example, without limitation, the “@” symbolmay be displayed next to the word “at”, or the “+” sign may be displayednext to the word “and”. Such images may be used for some or all of thewords or phrases in the predictive field 212. Such images may beassociated with words and/or phrases as stored at the database 116and/or the user device 110.

In exemplary embodiments, additional words, phrases, or images may begenerated for display in the predictive field 212 by user input. Forexample, without limitation, additional words, phrases, or images may begenerated by scrolling down through the generated list of words,phrases, or images. Upon reaching the end of the list, additional words,phrases, and images may be retrieved and displayed at the predictivefield 212 as described herein. Alternatively, or additionally, one ormore buttons may be available for user selection which cause theadditional words, phrases, and images to be retrieved and displayed.

Any embodiment of the present invention may include any of the optionalor exemplary features of the other embodiments of the present invention.The exemplary embodiments herein disclosed are not intended to beexhaustive or to unnecessarily limit the scope of the invention. Theexemplary embodiments were chosen and described in order to explain theprinciples of the present invention so that others skilled in the artmay practice the invention. Having shown and described exemplaryembodiments of the present invention, those skilled in the art willrealize that many variations and modifications may be made to thedescribed invention. Many of those variations and modifications willprovide the same result and fall within the spirit of the claimedinvention. It is the intention, therefore, to limit the invention onlyas indicated by the scope of the claims.

Certain operations described herein may be performed by one or moreelectronic devices. Each electronic device may comprise one or moreprocessors, electronic storage devices, executable softwareinstructions, and the like configured to perform the operationsdescribed herein. The electronic devices may be general purposecomputers of specialized computing device. The electronic devices may bepersonal computers, smartphone, tablets, databases, servers, or thelike. The connections described herein may be accomplished by wired orwireless means. Selections described herein may be made directly, suchas but not limited to, by way of one or more touch screen, or indirectlysuch as, but not limited to, by way of separate movement and selectiondevices, mouse, stylus, track pad, or the like.

What is claimed is:
 1. A system for assisting a user with a speechimpairment communicate with others through predictive language choiceoptions, said system comprising: a user device associated with the userand comprising a display; a database associated with the user device andcomprising words, phrases, images, and initial phrases, each associatedwith one or more context cues, wherein at least some of the one or morecontext cues are said initial phrases and other ones of said words,phrases, and images; and an electronic storage device associated withthe user device and comprising software instructions, which whenexecuted, configures a processor associated with the user device to:determine an initial user context for the user; identify certain of saidinitial phrases associated with certain of said one or more context cuesmatching said initial user context; display the identified initialphrases at said display of said user device; receive a user selection ofone of the displayed initial phrases; determine a further user contextfor the user based, at least in part, on said user selection; identifycertain of said words, phrases, and images associated with certain ofsaid one or more context cues matching the further user context; displaythe identified words, phrases, and images at said display of said userdevice; receive a subsequent user selection of at least one of thedisplayed words, phrases, and images; and communicate the selected oneof the initial phrases and all of a selected one or ones of the words,phrases, and the images on behalf of the user.
 2. The system of claim 1wherein: at least one speaker associated with the user device andconfigured to output audio within an audible range proximate to theuser; communication of the selected one of the initial phrases and allof the selected one or ones of the words, phrases, and the images onbehalf of the user is performed audibly by way of the at least onespeaker; and the electronic storage device comprises additional softwareinstructions, which when executed, configure the processor to identifyand audibly transmit literal equivalents of any selected images by wayof the at least one speaker.
 3. The system of claim 2 wherein: the atleast one speaker is located at the user device or separate andwirelessly connected to the user device; the user device comprises asmartphone or a tablet; the selected one of the initial phrases and allof the selected one or ones of the words, phrases, and the images areeach audibly transmitted upon selection by the user; the database, theelectronic storage device, and the processor are located at said userdevice; and the database is stored at the electronic storage device. 4.The system of claim 2 wherein: said database comprises one or moreemergency phrases; and said electronic storage device comprisesadditional software instructions, which when executed, configure theprocessor to: display an emergency button at the display of the userdevice; display said one or more emergency phrases upon receipt of dataindicating user selection of said emergency button; and automaticallyand immediately audibly transmit selected one or ones of said one ormore emergency phrases through said at least one speaker upon receipt ofdata indicating user selection of any of said displayed ones of said oneor more emergency phrases.
 5. The system of claim 1 wherein:communication of the selected one of the initial phrases and all of theselected one or ones of the words, phrases, and the images on behalf ofthe user is performed visually by electronic display of the selected oneof the initial phrases and all of the selected one or ones of the words,phrases, and the images.
 6. The system of claim 5 wherein: theidentified initial phrases and the identified words, phrases, and imagesare displayed at a predictive field at said display of said user device;the selected one of the initial phrases and all of the selected one orones of the words, phrases, and the images are displayed at a text fieldat said display of said user device; and the one or more context cuescomprise one or more complete sentences such that the words, phrases,and images displayed at the predictive field form partial or completesentences when added to the initial phrases, words, phrases, and imagesdisplayed at the text field.
 7. The system of claim 1 wherein: the oneor more context cues comprise one or more locations; the initial usercontext comprises a current location; the user device is configured todetermine the current location; and the electronic storage devicecomprises additional software instructions, which when executed,configures the processor to store, at the database, the communicatedinitial phrases, words, phrases, and images in association with thecurrent location as one of the one or more context cues.
 8. The systemof claim 1 wherein: said one or more context cues comprise one or moretimes of day; the initial user context comprises a current time of day;the user device is configured to determine the current time of day; andthe electronic storage device comprises additional softwareinstructions, which when executed, configures the processor to store, atthe database, the communicated initial phrases, words, phrases, andimages in association with the current time of day as one of saidcontext cues.
 9. The system of claim 1 further comprising: a peripheraldevice in electronic communication with the user device and configuredto track one or more of: heart rate, respiration rate, and perspirationrate, wherein said one or more context cues comprise one or more moods;and additional software instructions stored at the electronic storagedevice, which when executed by the processor, configures the user deviceto: determine a user's mood based on data received from the peripheraldevice, wherein the initial user context comprises the determined user'smood; and store, at the database, the communicated initial phrases,words, phrases, and images in association with the determined user'smood as one of said one or more context cues.
 10. The system of claim 1wherein: the one or more context cues comprise a user identity; theinitial user context comprises the user identity; and the electronicstorage device comprises additional software instructions, which whenexecuted, configure the processor to store, at the database, thecommunicated initial phrases, words, phrases, and images in associationwith the user identity as one of said one or more context cues.
 11. Thesystem of claim 1 further comprising: a microphone associated with theuser device; and additional software instructions stored at theelectronic storage device, which when executed, configures the processorto receive data from the microphone indicating words, phrases, andsentences spoken by others within a listening range of the microphone,wherein the initial user context comprises the words, phrases, andsentences spoken by others such that the initial phrases, words,phrases, and images retrieved from the database include those commonlyused in response to the words, phrases, and sentences spoken by othersas detected by said microphone.
 12. A method for assisting a user with aspeech impairment communicate with others through predictive languagechoice options, said method comprising the steps of: determining aninitial user context for the user based, at least in part, on data froma user device; retrieving initial phrases from a database associatedwith certain context cues matching said initial user context;electronically displaying said retrieved initial phrases at the userdevice; receiving a user selection of one of the displayed initialretrieved phrase; determining a further user context for the user based,at least in part, on said user selection; retrieving words, phrases, andimages from said database associated with certain of said context cuesmatching the further user context; electronically displaying saidretrieved words, phrases, and images at said user device; receiving asubsequent user selection of at least one of the displayed retrievedwords, phrases, and images; and communicating the selected one of theretrieved initial phrases and all of the selected displayed words,phrases, and the images.
 13. The method of claim 12 wherein: the step ofcommunicating the selected one of the retrieved initial phrases and allof the displayed selected words, phrases, and the images compriseselectronically displaying the selected one of the retrieved initialphrases and all of the displayed selected words, phrases, and theimages.
 14. The method of claim 12 wherein: the step of communicatingthe selected one of the retrieved initial phrases and all of thedisplayed selected words, phrases, and the images comprises audiblytransmitting the selected one of the retrieved initial phrases and allof the displayed selected words, phrases, and the images.
 15. The methodof claim 12 further comprising the steps of: updating associationsbetween the context cues and the retrieved initial phrases, words,phrases, and images at the database based upon the user selection andthe subsequent user selection.
 16. The method of claim 15 wherein: saidcontext cues comprise one or more of: a location, a time of day, a useridentity, a user mood, and words spoken to the user.
 17. An augmentativeand alternative communication (“AAC”) device utilizing predictivelanguage choice options comprising: an electronic display; one or moreaudio speakers; one or more processors; and one or more electronicstorage devices comprising: one or more databases comprising words,phrases, images, and initial phrases, each associated with one or morecontext cues, wherein at least some of the context cues are the initialphrases and other ones of said words, phrases, and images; softwareinstructions, which when executed, configure said one or more processorsto: determine an initial user context for a user; receive said initialphrases from said one or more databases associated with certain of saidcontext cues matching said initial user context for display at saidelectronic display; receive a user selection of one of said initialphrases displayed; determine a further user context for the user based,at least in part, on said user selection; receive said words, phrases,and images from said one or more databases associated with certain ofsaid one or more context cues matching the further user context fordisplay at said electronic display; receive a subsequent user selectionof at least one of the words, phrases, and images displayed; and audiblycommunicate the one of the initial phrases from the user selection andthe words, phrases, and the images from the subsequent user selection byway of said one or more speakers.
 18. The AAC device of claim 17 furthercomprising: additional software instructions stored at the one or moreelectronic storage devices, which when executed, configure the one ormore processors to update associations between said one or more contextcues and the initial phrases, words, phrases, and images at the one ormore databases based upon the user selection and the subsequent userselection.
 19. The AAC device of claim 17 wherein: the one or morecontext cues comprise one or more of: a location, a time of day, a useridentity, a user mood, and words spoken to the user.
 20. The AAC deviceof claim 17 further comprising: a microphone; and additional softwareinstructions stored at the one or more electronic storage devices, whichwhen executed, configure the one or more processors to receive data fromthe microphone indicating words, phrases, and sentences spoken by otherswithin an audio detection range of the microphone, wherein the initialuser context comprises the words, phrases, and sentences spoken byothers such that the initial phrases, words, phrases, and imagesretrieved from the one or more databases include those commonly used inresponse to the words, phrases, and sentences spoken by others asdetected by said microphone.